1 0 SCALABLE METHOD FOR RAPIDLY DETECTING POTENTIAL GROUND 

VEHICLES UNDER COVER USING VISUALIZATION OF TOTAL OCCLUSION 
FOOTPRINT IN POINT CLOUD POPULATION 

Inventor 

James M. Nelson 

1 5 Government License Rights 

This invention was made with Government support under U.S. Government contract 
DAAD17-01-C-0074 A001 awarded by Defense Advanced Research Projects Agency 
("DARPA"). The Government has certain rights in this invention. 

Field of the Invention 

20 This invention relates generally to radar systems and, more specifically, to improving 

detection of partially obstructed targets using line-of-sight imaging technologies. 

Background of the Invention 

Over the past several decades, radar and similar imaging technologies have greatly 
improved. For example, the advent of three-dimensional laser detection and ranging (ladar) 
25 systems has greatly increased the ability to detect objects of interest by generating imaging 
data with much greater resolution than was possible with predecessor technologies. A ladar 
device is capable of digitizing as much as a gigapoint - one billion points - for a single 
scene. Such high resolution potentially vastly improves the possibility of target detection in 
the imaged scene. 
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Two limitations potentially hamper the ability to detect targets using such a ladar 
system. First, in the case of ladar and other line-of-sight data gathering systems, targets can 
be concealed by intervening obstructions. For example, if a ground-based target is partially 
sheltered by foliage or another obstruction between a ladar system and the target, detection of 
5 the target becomes more difficult. To take a more specific example, if a vehicle is parked 
under a tree, data generated by an aerial ladar system may not clearly indicate the presence of 
the vehicle. Although the tree is at least a partially permeable obstruction, the presence of 
the tree changes the profile of the data collected and thus obscures the presence of the 
ground-based target. 

10 Second, the processing capability required to process enormous, gigapoint ladar 

images is overwhelming. Computer processing hardware performance has vastly improved, 
but not enough to completely process such a wealth of data. Computing time for processes 
such as mesh generation or sorting points may scale too slowly to be practical using available 
computing resources. For a number of raw data points, N, processing times for mesh 

15 generation or sorting points become practically unworkable for very large numbers of data 
points. Conventional methods involve processing times on the order of N log (N). To 
successfully meet objects of ladar and other sophisticated detection systems, more rapid 
detection of targets is desired than is possible with such a conventional processing system. 

To make processing ladar data practical, a number of steps to scale the vast number of 

20 raw data points must be minimized, parallelized, or simply eliminated. One method to 
reduce the volume of raw data is to sample the available data by selecting a subset of the 
available data points. Typically, sampling involves selecting a representative point from 
each of a number of zones from a pre-selected grid. Unfortunately, reducing the number of 
data points in such a manner reduces available spatial precision in resolving the area being 

25 scanned. 

One way to try to balance desires for high precision and tractable processing times is 
to allow a ladar operator to select and re-select alternative regions of interest in an area of 
study and to adjust spatial sampling resolution for those regions of interest. In this manner, 
the user can have desired precision and resolution on an as-desired basis, thereby allowing 
30 the user the greatest possible precision where the user wants it while not overwhelming the 
capacity of the ladar processing system. 

However, even if a ladar operator chooses to highlight a region of interest including a 
partially-obscured target, the processed data may not reveal the presence of the target to the 
operator. Thus, there is an unmet need in the art to improve detection of targets, particularly 
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where the targets may be at least partially obscured from a line-of-sight view by intervening 
objects. 

Summary of the Invention 

The present invention provides methods, computer-readable media, and systems for 
detecting concealed ground-based targets. Using visualization of total occlusion footprints 
generated from a point cloud population, embodiments of the present invention allow for 
detection of vehicles or other ground-based targets which otherwise might go undetected in a 
top-down analysis of a point cloud including the ground-based targets. 

More particularly, embodiments of the present invention provide for facilitating 
detection of an object in a point cloud of three-dimensional imaging data representing an area 
of study where the object potentially is obscured by intervening obstacles. The imaging data 
is processed to identify elements in the point cloud having substantially common attributes 
signifying that the identified elements correspond to a feature in the area of study. An 
isosurface is generated associating the elements having substantially common attributes. A 
reversed orientation visualization model for a region of interest is generated. The reversed 
orientation visual model exposes areas of total occlusion that potentially signify presence of 
the object. 

In accordance with further aspects of the present invention, three-dimensional 
imaging data of the scene is gathered, such as by using ladar. In accordance with still further 
aspects of the present invention, imaging data is processed using a population function 
computed on a sampling mesh by a Fast Binning Method (FBM). Also, the isosurface of the 
population function is computed using a marching cubes method. 

In accordance with other aspects of the present invention, an operator manually 
selects the region of interest. A non-reversed orientation visualization model is a top-down 
view of the region of interest and the reversed orientation visualization model is an up from 
underground visualization of the region of interest. The reversed orientation visualization 
model exposes areas of total ground occlusion, signifying position of potential objects of 
interest. 

Brief Description of the Drawings 

The preferred and alternative embodiments of the present invention are described in 
detail below with reference to the following drawing: 

FIGURE 1 is a flowchart of a routine for detecting targets according to an 
embodiment of the present invention; 

FIGURE 2 is a depiction of available three-dimensional data including a target; 
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FIGURE 3 is a top-down visualization of a region of interest including targets not 
discernible in this visualization; 

FIGURE 4 is an "up from underground" visualization of a region of interest 
according to an embodiment of the present invention showing targets partially-obscured in a 
5 top-down visualization; and 

FIGURE 5 is a system according to an embodiment of the present invention. 

Detailed Description of the Invention 

By way of overview, embodiments of the present invention provide for facilitating 
detection of an object in a point cloud of three-dimensional imaging data representing an area 

10 of study where the object potentially is obscured by intervening obstacles. The imaging data 
is processed to identify elements in the point cloud having substantially common attributes 
signifying that the identified elements correspond to features in the area of study. An 
isosurface is generated associating the elements having substantially common attributes. A 
reversed orientation visualization model for a region of interest is generated. The reversed 

15 orientation visual model exposes areas of total occlusion that potentially signify presence of 
the object. 

Referring now to FIGURE 1, a routine 100 according to one presently preferred 
embodiment of the present invention includes three processes facilitating detection of an 
object in a point cloud of three-dimensional imaging data. The data is collected from an area 

20 of study where the object potentially is obscured by intervening obstacles. The routine 100 
begins at a block 110. At a block 120 the imaging data is processed to identify elements in 
the point cloud having substantially common attributes. The common attributes signify that 
the identified elements correspond to a feature in the area of study. At a block 130 an 
isosurface associating the elements having substantially common attributes is generated. The 

25 isosurface provides for a visual depiction of the feature or features in the area of study. The 
visual depiction may not disclose presence of an object because the object may be concealed 
by intervening objects. For example, where the imaging data is gathered from an aerial 
location, the object may be a vehicle parked under one or more trees where the object is 
generally hidden from view. At a block 140, a reversed orientation visualization model for a 

30 region of interest is generated. Even though the object may be obscured from view from the 
aerial location by trees or other permeable or porous obstacles, elements in the three- 
dimensional data collected may signify presence of solid objects beneath the obstacles. 
Generating a reversed orientation visualization model, such as an up from underground 
representation derived from aerially-collected, top-down imaging data, reveals the presence 

35 of the objects. The routine 100 ends at a block 150. 
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FIGURE 2 is a depiction of available three-dimensional data 200. The data includes 
a number of radar scans 210. Each of the scans 210 plots a number of raw data points at 
varying azimuth 220 and elevations 230. Each of the scans 210 is part of a series of scans 
240, such as may be collected on a sortie or pass over the area under study using an aerial 
5 imaging platform such as an aircraft. In the area under study is a target 250 which, in this 
case, is a vehicle. The target vehicle 250 is obscured from view by an intervening object 
260, such as leafy tree limbs. No single scan 210 may reveal the presence of the target 250 
because of the intervening object 260 obscuring the view of the target 250 from an 
observation point (not shown). However, because the intervening object 260 is partially 
10 permeable, data collected from the combination of the radar scans 210 may reveal a number 
of points signifying presence of a non-permeable, non-porous object beneath the intervening 
object. 

As will be further described below, the implied geometry generated from the scans 
210 allows for the collective implied geometries to be resolved revealing a total occlusion 

15 zone resolvable into the shape of the target 250. The implied geometry is derived by 
associating selected data points having equivalent scalar values as calculated from the 
collected data. Using the implied geometry instead of an explicit geometry presents a 
number of advantages. One advantage is that the representation of the implied geometry 
includes an infinite number of explicit geometries, such as isosurfaces of the volume field or 

20 a permutation of its spatial derivatives instead of a single, fixed geometry. As a result, 
ambiguities concerning separation of an adjacent object recede, thereby allowing for reliable 
analysis even when point cloud data sets have slightly different characteristics. Further 
advantageously, many local area search and clutter rejection processing steps can be applied 
to all implied geometries simultaneously. Further, selecting the implicit geometry 

25 representation allows level set methods to be developed to replace existing explicit geometry 
solutions. Use of level set methods allow processing performance to exceed fundamental 
limits which restrict the maximum processing speed possible based on explicit geometrical 
representations. 

In one presently preferred embodiment, image processing at the block 120 uses a 
30 population function computed on a sampling mesh by the Fast Binning Method (FBM). 
FBM is scalable with the number of data points N, and is fully parallelizable. FBM uses 
integer truncation of each resolution-scaled coordinate to index a data array element to be 
incremented. As a result, the values of each sampling point in the computed scalar field 
numerically correspond to a number of raw data points close to the sampling point. A raw 
35 data point may be considered suitably close to the sampling point if, for example, the raw 
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data point is within one-half resolution element of the sampling point. Based on the 
generated population function, the marching cubes method is used to dynamically compute 
the isosurface of the population function on the sampling mesh. The marching cubes method 
scales in proportion to the number of sampling points. For example, where M is the number 

5 of sampling points, the marching cubes method scales in proportion with M log(M). 

Another advantage of the population function's implied geometrical representation is 
that it allows geometrical information to be sampled and distributed at different resolutions in 
parallel thereby allowing for distributed, networked processing and interrogative 
communication. Support for parallel, distributed processing allows for high processing 

10 speeds and redundancy to make loss of one or more single processors endurable. Also, the 
available parallelism supports dynamic resource allocation. 

The data is collected from an area of study where the object potentially is obscured by 
intervening obstacles. The routine 100 begins at a block 110. At a block 120 the imaging 
data is processed to identify elements in the point cloud having substantially common 

15 attributes. The common attributes signify that the identified elements correspond to a feature 
in the area of study. At a block 140, a reversed orientation visualization model for a region 
of interest is generated. Even though the object may be obscured from view from the aerial 
location by trees or other permeable or porous obstacles, elements in the three-dimensional 
data collected may signify presence of solid objects beneath the obstacles. Generating a 

20 reversed orientation visualization model, such as an up from underground representation 
derived from aerially-collected, top-down imaging data, reveals the presence of the objects. 

At a block 130 the isosurface associating the elements having substantially common 
attributes is generated. Isosurfaces present a visual depiction of the implied geometries of 
the identified features. In one presently preferred embodiment, isosurfaces are depicted as 

25 particular shades or colors on an output display. Setting of the isosurface levels suitably is 
performed automatically as a function of the sampling resolution, adjusting the variation in 
shade or color per isosurface elevation to reflect the differentiation available from the 
collected data. 

From the processed and isosurface-represented data, a particular region of interest 
30 may be identified to reduce processing requirements as compared to conducting further 
processing on the entire area of study. For the reasons previously described, performing a 
full analysis of all the collected data may be a computationally-prohibitive process. 
Accordingly, based on general features of the area under study, a human operator may 
identify features that may obscure objects of interest. 
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At the block 140, the implied geometries presented by the population function are 
used to generate the "up from underground" oriented visualization model. The description of 
an "up from underground" visualization model contemplates a system in which data about a 
region of interest at a low elevation is gathered from a higher elevation observation point 
5 with obscuring, intervening objects at an elevation between the region of interest and the 
observation point. For example, data suitably is collected from an aerial observation point, 
such as an aircraft, about the ground below. Other embodiments of the present invention are 
usable to collect data from a low elevation observation point about a higher elevation area of 
interest. For example, data suitably is collected from a ground level observation point about 

10 a high altitude region of interest. 

As shown by the example in FIGURE 3, in the case of a study of a ground-level 
region of interest a top-down visualization 300 of a region of interest 310 includes 
isosurfaces of differently-elevated attributes in the field of study. The region of interest 310 
includes a plain 320, such as a field, and an elevated feature such as a stand of trees or a 

15 forest 330. The plain 320 is represented by an isosurface with a level associated with a dark 
shade as shown in FIGURE 3. On the other hand, the trees 330 are associated with a 
plurality of different, lighter shades depending on the generated isosurfaces of the trees 330 
or parts thereof. Instead of shades, the different isosurfaces could be represented by different 
colors, fill patterns, etc. Not discernible in the region of interest 310 includes two parked 

20 vehicles. In FIGURE 3, the trees 330 obscure the vehicles from view in the visualization 
shown. 

FIGURE 4 shows an inverted visualization 400 of the same region of interest 310. 
Instead of generating the visualization 300 from the perspective of the observation point as in 
FIGURE 3, the visualization 400 is computed as it would appear from the perspective of the 

25 ground looking upward. As shown in FIGURE 4, the visualization 400 presents a very 
different view. The visualization 400 again shows the plain 420 as a darkly-shaded region. 
However, instead of showing the canopy of the stand of trees 320 (FIGURE 3), the 
visualization 400 shows areas of total occlusion (tree trunks 420 and vehicles 430) 
representing solid forms at ground level. Trunks of trees are resolved as solid points. 

30 Visually differentiable from the tree trunks 420 are the very regular forms of vehicles 430 
which were not visible in the top-down visualization 300 (FIGURE 3). In other words, by 
recharacterizing and representing the three-dimensional data collected in the scans 210 
(FIGURE 2), an "up from underground" visualization 400 allows previously-concealed 
targets or objects to be discerned. 
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FIGURE 5 shows a system 500 according to an embodiment of the present invention. 
The system 500 includes a data gathering device 510. In one presently preferred 
embodiment, the data gathering device 510 is a three-dimensional imaging device, such as a 
ladar system, configured to gather three-dimensional data about an area of study. Receiving 
5 the data from the data gathering device 510 is an image processor 520. Using techniques 
previously described, the image processor 520 uses a population function to derive implied 
geometries of features imaged by the data gathering device 510. An isosurface generator 530 
presents isosurfaces of points for which the population function generator 520 yields 
equivalent scalar values. A region of interest selector 540 allows an operator to manually 
10 identify a particular region of interest from among the isosurface data presented for further 
study. For the region of interest so identified, a visualization model generator 550 generates 
an up from underground visualization model of the isosurface data, allowing an operator to 
perceive areas of shows areas of total occlusion that potentially represent targets or other 
objects of interest. 

15 While preferred embodiments of the invention have been illustrated and described, 

many changes can be made to these embodiments without departing from the spirit and scope 
of the invention. Accordingly, the scope of the invention is not limited by the disclosure of 
the preferred embodiment. Instead, the invention should be determined entirely by reference 
to the claims that follow. 

20 
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